IN THE CLAIMS : 

The following is a complete listing of the claims in this application, reflects all 
changes currently being made to the claims, and replaces all earlier versions and all earlier 
listings of the claims: 

Claim 1. (Currently Amended) An information processing device for aiding 
control operations relating to controlling the position and orientation of a virtual object, said 
device comprising: 

image-capturing means for capturing a real image in real space; 

virtual image generation means for generating a virtual image of a virtual object 
according to the position and orientation of said image capturing means; 

superimposed means for superimposing the generated virtual image with the 
captured real image; 

inputting means for inputting three-dimensional position information of a plurality 
of positions inputted by a user moving a real object in the real space by a user ; 

setting means for setting a constraining shape based on the inputted 
three-dimensional position information; and 

operating means for performing an operation controlling the position and the 
orientation of the virtual object based on the constraining shape in accordance with a user's 
instructions. 

Claim 2. (Previously Presented) An information processing device according to 
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Claim 1, wherein the constraining shape is defined by polygons and the apexes of the polygons 
are at positions inputted by the user or the constraining shape is a plane passing through the 
positions inputted by the user. 

Claim 3. (Previously Presented) An information processing device according to 
Claim 1, wherein said operating means performs at least one of the following operations in 
performing an operation controlling the position and orientation of the virtual object: 

a translation operation for causing translational movement of the virtual object 
based on the constraining shape; or 

a rotation operation for rotating the virtual object on an axis which is a normal 
vector at a plane where the constraining shape and the virtual object come into contact. 

Claim 4. (Canceled) 

Claim 5. (Currently Amended) An information processing method for aiding 
control operations relating to controlling the position and orientation of a virtual object, said 
method comprising: 

an image capturing step of capturing a real image in real space; 

a virtual image generation step of generating a virtual image of a virtual object 
according to the position and orientation of said image capturing step; 

a superimposing step of superimposing the generated virtual image with the 
captured real image; 
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an inputting step of inputting three dimensional position information of a plurality 
of positions inputted by a user moving a real object in the real space by a user ; 

a setting step of setting a constraining shape based on the inputted three 
dimensional position information; and 

an operating step for performing an operation controlling the position and the 
orientation of the virtual object based on the constraining shape in accordance with a user's 
instructions . 

Claim 6. (Previously Presented) An information processing method according to 

Claim 5, 

wherein said setting step sets a constraining shape is defined by polygons 
comprising the apexes of the polygons being at positions inputted by the user in said inputting 
step or sets a constraining shape comprising a plane passing through the positions inputted by the 
user in said inputting step. 

Claim 7. (Previously Presented) An information processing method according to 
Claim 6, wherein said operating step comprises the steps of: 

causing translational movement of the virtual object based on the constraining 

shape; and 

rotating the virtual object on an axis which is a normal vector at a plane where the 
constraining shape and the virtual object come into contact . 
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Claim 8. (Previously Presented) A computer program product comprising a 
computer readable medium storing computer program code for performing the information 
processing method according to Claim 5, wherein the information processing method is executed 
by a computer device. 

Claim 9. (Previously Presented) A computer-readable recording medium, storing 
the computer program code according to Claim 8. 

Claim 10. (Currently Amended) An information processing method for changing 
the position and orientation of a virtual object in mixed reality space obtained by combining a 
real image space and a virtual image space , said method comprising the steps of: 

obtaining a constraining shape from three-dimensional position information of a 
plurality of positions in real space designated by a user using an operating unit moved by a user 
in the real space capable of obtaining three-dimensional positional information ; 

obtaining a constraining shape based on the obtained three-dimensional position 

information; 

changing the position and orientation of the virtual object according to 
instructions from the user, based on the obtained constraining shape as constraint condition; and 

combining an image of the virtual object generated according to the changed 
position and orientation, and the real image, to obtain a mixed reality image. 

Claim 11. (Previously Presented) An information processing method according to 
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Claim 10, further comprising the step of combining a virtual image indicating the constraining 
shape with the real image. 



Claim 12. (Original) An information processing method according to Claim 10, 
wherein the constraining shape is a plane. 

Claim 13. (Previously Presented) An information processing method according 
to Claim 10, wherein said changing step changing the position and orientation of the virtual 
object is carried out by changing the position and orientation of the operating unit. 

Claim 14. (Previously Presented) A computer program product comprising a 
computer readable medium storing computer program code for performing the information 
processing method according to Claim 10, wherein the information processing method is 
executed by a computer device. 

Claim 15. (Previously Presented) A computer-readable recording medium, 
storing the computer program code according to Claim 14. 

Claim 16. (Currently Amended) An information processing device for aiding 
control operations relating to controlling the position and orientation of a virtual object, said 
device comprising: 

an image- capturing unit configured to capture a real image in real space; 
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a virtual image generation unit configured to generate a virtual image of a virtual 
object according to the position and orientation of said image capturing unit; 

a superimposing unit configured to superimpose the generated virtual image with 
the captured real image; 

an inputting unit configured to input three-dimensional position information of a 
plurality of positions inputted by a user moving a real object in the real space by a user ; 

a setting unit configured to set a constraining shape based on the inputting 
three-dimensional position information; and 

an operating unit configured to control the position and orientation of the virtual 
object based on the constraining shape in accordance with a user's instruction. 

Claim 17. (Previously Presented) An information processing device according to 
Claim 16, wherein the constraining shape is defined by polygons and the apexes of the polygons 
are at positions inputted by the user or the constraining shape is a plane passing through the 
positions inputted by the user. 

Claim 18. (Previously Presented) An information processing device according to 
Claim 16, wherein said operating unit performs at least one of the following operations in 
performing an operation controlling the position and orientation of the virtual object: 

a translation operation for causing translational movement of the virtual object 
based on the constraining shape; or 

a rotation operation for rotating the virtual object on an axis which is a normal 
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vector at a plane where the constraining shape and the virtual object come into contact. 



Claim 19. (Canceled) 
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